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Does brain activity stem from high-dimensional chaotic dynamics ? 
Evidence from the human electroencephalogram, cat cerebral 
cortex and artificial neuronal networks 



Received: date / Revised: date 

Abstract Nonlinear time series analyses have suggested that 
the human electroencephalogram (EEG) may share statisti- 
cal and dynamical properties with chaotic systems. During 
slow-wave sleep or pathological states like epilepsy, corre- 
lation dimension measurements display low values, while in 
awake and attentive subjects, there is not such low dimen- 
sionality, and the EEG is more similar to a stochastic vari- 
able. We briefly review these results and contrast them with 
recordings in cat cerebral cortex, as well as with theoreti- 
cal models. In awake or sleeping cats, recordings with mi- 
croelectrodes inserted in cortex show that global variables 
such as local field potentials (local EEG) are similar to the 
human EEG. However, in both cases, neuronal discharges 
are highly irregular and exponentially distributed, similar 
to Poisson stochastic processes. To attempt reconcile these 
results, we investigate models of randomly-connected net- 
works of integrate-and-fire neurons, and also contrast global 
(averaged) variables, with neuronal activity. The network 
displays different states, such as "synchronous regular" (SR) 
or "asynchronous irregular" (AI) states. In SR states, the 
global variables display coherent behavior with low dimen- 
sionality, while in AI states, the global activity is high-dim- 
ensionally chaotic with exponentially distributed neuronal 
discharges, similar to awake cats. Scale-dependent Lyapunov 
exponents and e-entropies show that the seemingly stochas- 
tic nature at small scales (neurons) can coexist with more 
coherent behavior at larger scales (averages). Thus, we sug- 
gest that brain activity obeys similar scheme, with seem- 
ingly stochastic dynamics at small scales (neurons), while 
large scales (EEG) display more coherent behavior or high- 
dimensional chaos. 
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1 Introduction 

A number of methods from nonlinear dynamical systems 
have been applied to the different states of the human EEG. 
Early studies have calculated correlation dimensions from 
EEG and reported evidence for low-dimensional chaos for 
slow-wave sleep [Babloyantz et al., 1985; Mayer-Kress et 
al., 1988], as well as for pathological states such as epilepsy 
[Babloyantz & Destexhe, 1986; Frank et al., 1990] or the 
terminal state of Creutzfeldt- Jakob disease [Destexhe et al., 
1988]. These findings have been confirmed by numerous 
studies [reviewed in Destexhe, 1992; Elbert et al., 1994; Korn 
& Faure, 2003]. Interestingly, in these studies, the EEG dy- 
namics during wakefulness or REM sleep did not show ev- 
idence for low-dimensional dynamics. These results were 
also corroborated with other measurements such as Lyapunov 
exponents, entropies, power spectral densities, autocorrela- 
tions and symbolic dynamics [Destexhe, 1992]. 

The existence of low-dimensional chaotic dynamics in 
systems with such large degrees of freedom is surprising. 
Chaotic dynamics in extended coupled systems have been 
studied extensively for the last decades and is still a matter 
of intense investigation. In particular, for network of sim- 
plified neurons, as the spin-glass models, mean-field theo- 
ries have proven the existence of stable chaotic attractors 
[Sompolinsky et al., 1988; van Vreeswijk & Sompolinsky, 
1996; van Vreeswijk & Sompolinsky, 1998]. These systems 
have been shown to exhibit chaotic persistence regarding pa- 
rameter changes [Albers et al., 2006], a property that makes 
chaotic dynamics more common than exceptional [Sprott, 
2008] . From a computational point of view, chaotic behaviour 
or nearly chaotic regime (edge of chaos) can be optimal for 
information processing [Bertschinger & Natschlager, 2004; 
Legenstein & Maass, 2007]. In network models of spiking 
neurons, chaotic regimes have also been studied [Cessac, 
2008; Cessac & Vieville, 2008] and can be present only as 
transients during which the system is numerically indistin- 
guishable from a usual chaotic attractor. However the life- 
time of these transient periods is known to increase exponen- 
tially with network size [Crutchfield & Kaneko, 1988; Tel & 



2 



Lai, 2008] making them more relevant in practice than the 
real stable attractor for large enough networks. 

In this paper, we intend to study a specific spiking neuron 
model which displays these properties and yield biophysical 
behaviour relevant to understand EEG data. Classical non- 
linear tools as the correlation dimension or the Lyapunov 
exponents have given some insight on macroscopic quanti- 
ties as the EEG or the overall activity of numerical mod- 
els but are often criticized because of their limitation for 
low-dimensional dynamics [Kantz & Schreiber, 2004]. In 
order to distinguish between microscopic dynamics and col- 
lective behaviour, we borrow recent tools developed in the 
context of high-dimensional systems and which offer anal- 
ysis at different scales. In particular, finite-size Lyapunov 
exponent [Aurell et al., 1997] as well as e— entropy [Gas- 
pard & Wang, 1993] provide a scale-dependent description 
of spiking neuron networks and could detect whether or not 
low-dimensional dynamics prevail at a macroscopic scales. 
These tools will be applied to EEG data as well as numerical 
models. 



2 Methods 

In this section we briefly describe the analytical and numer- 
ical tools which will be used to probe the nonlinear nature 
of the EEG recordings or the numerical simulations. Most of 
these analysis are extensively used in the literature. Further- 
more, we used the TISEAN toolbox [Hegger et al., 1999] to 
perform most of our nonlinear analysis. We also give infor- 
mation about the numerical model. 



2.1 Phase space reconstruction 

We used the method of time-delayed vectors of the time se- 
ries, which yields reconstructed attractors topologically equiv- 
alent to the original attractor of the system [Takens, 1981; 
Sauer et al., 1991]. We chose a fixed delay parameter de- 
termined by the first minimum of the mutual information 
[Eraser & Swinney, 1986]. The embedding dimension was 
chosen such that any self-similar asymptotic behavior satu- 
rates beyond this dimension, indicating a successful attractor 
reconstruction. 



2.2 Correlation dimension 

The correlation dimension was measured from the correla- 
tion integral [Grassberger & Procaccia, 1983] which is esti- 
mated by using 

1 ^ 

C{e) = jj^Y^0{e-Hi)-x{j)\\) (1) 

where x(;) G IR is the m-dimensional delay vector and e is 
a threshold distance which reflects the scale under consider- 
ation. Moreover we used a Theiler window [Theiler, 1990] 



according to the temporal correlation of each time series to 
avoid spurious estimation. If the correlation integral mani- 
fests a power-law behavior over a range of scale which sat- 
urates with increasing embedding dimension, the correla- 
tion dimension is simply the corresponding power-law co- 
efficient. 



2.3 Recurrence plots 

This tool provides an intuitive visualization of recurrences 
in trajectories on the attractor [Eckmann et al., 1987]. The 
recurrence matrix is defined by 

RP{i,j) = 0{e-\\x{i)-x{j)\\) (2) 

where the matrix entry is equal to 1 if the trajectory x at / is 
in the e-neighbor of itself at j and otherwise. Stereotypic 
patterns in the recurrence plot can indicate the existence of 
periodic behavior, low-dimensional chaos or stochastic-like 
dynamics. In particular, diagonal lines are typical of periodic 
dynamics whereas clouds of dots are produced by a stochas- 
tic component. For an extensive review on recurrence plot, 
the reader should refer to [Marwan et al., 2006]. 



2.4 Finite-size Lyapunov and e-entropy 

Scale-dependent nonlinear analysis have been greatly stud- 
ied the last decade and have come in handy to distinguish 
deterministic (possibly chaotic) dynamics from stochastic 
noise. In this paper, we will mainly consider two quanti- 
ties : the Finite-Size Lyapunov Exponent (FSLE) and the 
e-entropy. The former has been introduced in the context of 
developed turbulence [Aurell et al., 1997] and has proven to 
be more suited for a broad range of system which dynam- 
ics can exhibit low-dimensional chaotic behavior only on 
large-scale [Shibata & Kaneko,1998; Cencini et al., 1999; 
Gao et al., 2006]. Roughly speaking, if we want to quantify 
the sensitivity to initial conditions on large scales, it is nec- 
essary to consider perturbations which are not infinitesimal. 
Therefore, the FSLE can be defined as follows 

where for a perturbation between two initial trajectories 5, 
Tr is the minimal time required for those trajectories to be 
separated by a distance Ar greater than or equal to dr where 
r = 2 is usually taken. The brackets in Eq. [3] denotes aver- 
ages on the attractor for many realizations. The e-entropy is 
a generalization of the Kolmogorov-Sinai entropy rate [Gas- 
pard & Wang, 1993] which is defined for a finite scale e and 
time delay T by 

/t(e,T) = lim h,„{e,T) (4) 
= - lim -//„,(e,T) (5) 
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with 

h„,{e, t) = -{H,„+i (e, t) - H,„{e, t) (6) 

T 

where Hm{e,T) is the entropy estimated with box partition 
of the phase space for box size given by e on the attractor 
reconstructed with a time delay T and an embedding dimen- 
sion m. This quantity exhibits a plateau on particular scales 
if a deterministic low-dimensional dynamics occurs at these 
scales. It can thus be used to describe large scale dynamics 
independently of the small scale noisy behavior or can be 
used to distinguish noise from chaos in some cases [Cencini, 
2000]. 



2.5 Avalanche analysis 

To identify the presence of scale invariance, typical of self- 
organized critical states [Jensen, 1998], we used an "avalanche 
analysis" methods [Beggs and Plenz, 2003]. This method 
consists of detecting "avalanches" as clusters of contiguous 
events separated by silences, by binning the system's activ- 
ity in time windows (1 ms to 16 ms were used). Cluster of 
events were defined from the spike times among the ensem- 
ble of simultaneously recorded neurons. The scale invari- 
ance was determined from the distribution of avalanche size, 
calculated as the total number of events [Beggs and Plenz, 
2005]. 



2.6 Network of Integrate-and-Fire neurons 

Networks of "integrate-and-fire" neurons were simulated ac- 
cording to models and parameters published previously [Vo- 
gels & Abbott, 2005; El Boustani et al., 2007]. The network 
consisted of 5,000 neurons, which were separated into two 
populations of excitatory and inhibitory neurons, forming 
80% and 20% of the neurons, respectively. All neurons were 
connected randomly using a connection probability of 2%. 
The membrane equation of cell ; was given by: 

Cm ^ = -gdVi-EL) + Si{t) + G,(0 , (7) 
at 

where C,„ = 1 /iF/cm^ is the specific capacitance, V, is the 
membrane potential, gL = 5x 10~^ S/cm^ is the leak conduc- 
tance density and El = -60 mV is the leak reversal potential. 
Together with a cell area of 20,000 /im^, these parameters 
give a resting membrane time constant of 20 ms and an input 
resistance at rest of 100 MQ. The function Si{t) represents 
the spiking mechanism intrinsic to cell and G, (f ) stands for 
the total synaptic current of cell /. Note that in this model, 
excitatory and inhibitory neurons have the same properties. 

In addition to passive membrane properties, IF neurons 
had a firing threshold of -50 mV. Once the Vm reaches thresh- 
old, a spike is emitted and the membrane potential is reset to 
-60 mV and remains at that value for a refractory period of 
5 ms. This model was inspired from a previous publication 



reporting self-sustained irregular states [Vogels and Abbott, 
2005]. 

Synaptic interactions were conductance-based, accord- 
ing to the following equation for neuron i: 

Gi{t) = -Y^gjiitm^Ej), (8) 
j 

where V, is the membrane potential of neuron gji{t) is the 
synaptic conductance of the synapse connecting neuron j to 
neuron and Ej is the reversal potential of that synapse. Ej 
was mV for excitatory synapses, or -80 mV for inhibitory 
synapses. 

Synaptic interactions were implemented as follows: when 
a spike occurred in neuron j, the synaptic conductance gji 
was instantaneously incremented by a quantum value {qe = 
6 nS and qj - 67 nS for excitatory and inhibitory synapses, 
respectively) and decayed exponentially with a time constant 
of T(, = 5 ms and T, = 10 ms for excitation and inhibition, re- 
spectively. 



3 Evidence for chaotic dynamics in EEG activity 

Human EEG recordings during different brain states are il- 
lustrated in Fig. [U along with a 2-dimensional representa- 
tion of the phase portrait obtained from each signal. Dur- 
ing wakefulness (eyes open) and REM sleep, the dynamics 
is characterized by low-amplitude and very irregular EEG 
activity, while during deep sleep, the EEG displays slow 
waves ("delta waves") of large amplitude. Oscillatory dy- 
namics with a frequency around 10 Hz is seen in the occipi- 
tal region when the eyes are closed ("alpha rhythm"). Patho- 
logical states, such as epilepsy or comatous states, display 
large amplitude oscillations, which are strikingly regular. 

A first evidence for chaotic dynamics is that EEG dy- 
namics display a prominent sensitivity to initial conditions. 
This sensitivity is illustrated in Fig. |2] for the alpha rhythm 
(awake eyes closed) and slow-wave sleep (stage IV). A set 
of close initial conditions is defined by choosing a neigh- 
boring points in phase space, and this set of points is fol- 
lowed in time. The divergence of the trajectories emanating 
from each initial condition is evident from the illustration of 
Fig. |2] and is actually exponential. This exponential diver- 
gence betrays the presence of at least one positive Lyapunov 
exponent. A more quantitative investigation using numerical 
methods [Wolf et al., 1985] reveals the presence of positive 
Lyapunov exponents for all EEG states investigated [Des- 
texhe, 1992]. 

EEG dynamics also displays other characteristics of chaotic 
dynamical systems, such as broad-band power spectra (not 
shown) and fractal attractor dimensions. This latter point 
was investigated by a number of laboratories, and is sum- 
marized in Fig. [3] Correlation integrals C(r) are calculated 
from the reconstructed phase portraits for different embed- 
ding dimensions (Fig. [3K-B). The correlation dimension d 
is obtained by estimating the scaling of C(r) by using loga- 
rithmic representations, in which the slope directly gives an 
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Fig. 1 Electroencephalogram signals and phase portraits during differ- 
ent brain states in humans. 

Left: 5 seconds of EEG activity in different brain states (same ampli- 
tude scale). Right: 2-dim phase portrait of each signal. Modified from 
[Destexhe, 1992]. 
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Fig. 2 Illustration of the sensitivity to initial conditions in EEG dy- 
namics. 

A cluster of neighboring points in phase space (leftmost panels) is fol- 
lowed in time and is shown on the same phase portrait after 200 ms, 
400 ms and 3 seconds (from left to right; same data as in Fig. [TJ. A, 
Awake eyes closed; B. Sleep stage IV. Modified from [Destexhe, 1992]. 



estimate of d. The calculation of d as a function of the em- 
bedding dimension (Fig. |3t! ) saturates to a constant values 
for some states (such as deep sleep or pathologies), but not 
for others. This is the case for the EEG during wakefulness, 
which dimension d does not saturate, which is a sign of high 
dimensionality. 

The correlation dimensions obtained for different brain 
states are represented in Fig. |4] as a function of the mean 




Embedding dimension m 

Fig. 3 Correlation dimension calculated from different brain states in 
humans. 

A. Correlation integrals C(r) calculated from sleep stage IV. B. Cor- 
relation integrals calculated from Awake eyes open. C. Correlation 
dimension as a function of embedding dimension for different brain 
states. Symbols: * = Awake eyes open, + = REM sleep, squares = sleep 
stage 2, circles = sleep stage 4. Modified from [Destexhe, 1992]. 



amplitude of the EEG signal. This representation reveals a 
"hierarchy" of dimensionalities for the EEG. The aroused 
states, such as wakefulness and REM sleep, are character- 
ized by high dimension and no sign of slow-wave activ- 
ity. As the brain drifts towards sleep, the dimensionality de- 
creases and attains its lowest level during the deepest phase 
of sleep, in which the EEG is dominated by large-amplitude 
slow waves. A further decrease is seen during pathologies, 
which are also dominated by slow-wave activity. 
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Fig. 4 Dimension - amplitude representation for different brain states. 
The correlation dimension of the EEG is shown as a function of the 
amplitude range (maximal amplitude deflection calculated over I sec- 
ond periods. Modified from [Destexhe, 1992]. 
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4 Evidence for stochastic dynamics in brain activity 

The above results are consistent with the idea that awake 
brain activity may be associated with high-dimensional dy- 
namics, perhaps analogous to a stochastic system. To fur- 
ther investigate this aspect, we have examined data from 
animal experiments in which both microscopic (cells) and 
macroscopic (EEG) activities can be recorded. The corre- 
spondence between these variables is shown in Fig.|5]for cat 
cerebral cortex during wakefulness and slow-wave sleep. 
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Fig. 5 Distributed firing activity and local field potentials in cat cortex 
during wake and sleep states. 

Recordings were done using eight bipolar tungsten electrodes in cat 
parietal cortex (data from [Destexhe et al., 1999]). The irregular firing 
activity of 8 multi-units is shown at the same time as the LFP recorded 
in electrode 1 . During wakefulness, the activity is sustained and irreg- 
ular (see magnification below). During slow-wave sleep (SWS), the 
activity is similar as wakefulness, except that "pauses" of firing occur 
in all cells, and in relation to the slow waves (one example is shown in 
gray in the bottom graph). The boxes in the top graphs are shown in 
bottom graphs at 20 times higher temporal resolution. 



Those electrical measurements were made using tung- 
sten microelectrodes directly inserted in cortical gray matter 
[Destexhe et al., 1999]. This recording system enables the 
extraction of two signals: a global signal, similar to the EEG, 
which is called "local field potential" (LFP) and reflects the 
averaged electrical activity of a large population of neurons. 
In addition, single neurons can be distinguished and can be 
extracted. These signals are shown and compared in Fig.[5j 
During wakefulness, the LFP shows low-amplitude irregu- 
lar activity, while neuronal discharges seem random. Slow- 
wave sleep is characterized by dominant delta waves in the 
LFP, as in human sleep stage IV. The occurrence of slow 



waves is correlated with a concerted pause in the firing of 
the neurons [Destexhe et al., 1999]. 

Analyzing the spike discharge of single neurons revealed 
that the interspike-intervals (ISI) are exponentially distributed, 
in a manner indistinguishable from a Poisson stochastic pro- 
cess (Fig. |6K)- Performing an avalanche analysis revealed 
that the distribution of avalanche size from the neuronal dis- 
charges was also exponential (Fig. |6^). The same scaling 
could be explained by uncorrelated Poisson processes, as if 
the neurons discharged randomly and independently. This 
analysis was reproduced from a previous study (Bedard et 
al., 2006). 
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Fig. 6 Analysis of neuronal activity in awake cat cerebral cortex. 
A. Interspike interval (ISI) distributions computed from extracellularly 
recorded neurons in wakefulness (natural logarithms). A Poisson pro- 
cess with the same average rate is shown for comparison (blue; curve 
displaced upwards for clarity). The inset shows a log-log represen- 
tation. The red curves indicate the theoretical value for Poisson pro- 
cesses. B. Avalanche analysis of extracellular recordings in the awake 
cat (natural logarithms). The same analysis was performed on surro- 
gate data (blue; Poisson processes). The inset shows the same data in 
log-log representation. Modified from Bedard et al., 2006. 



Thus, these data and analysis show that the dynamics of 
neuronal activity in the awake cerebral cortex is similar to 
stochastic processes. The statistics of the ISI distributions, 
as well as the collective dynamics ("avalanches") cannot be 
distinguished from a Poisson stochastic processes. 



5 Models of irregular dynamics in neuronal networks 

We next consider if this type of dynamics can be found in 
theoretical models of neuronal networks. We consider ran- 
domly-connected networks of excitatory and inhibitory point 
neurons, in which firing activity is described by the "integrate - 
and-fire" model, while synaptic interactions are conductance- 
based. As shown in previous publications (Vogels and Ab- 
bott, 2005; El Boustani et al., 2007), this model can display 
states of activity consistent with recordings in awake neocor- 
tex, as shown in Fig. |7] The network can display different 
types of states, such as "synchronous regular" (SR) states, 
or "asynchronous irregular" (Al), both of which are illus- 
trated in Fig. I?] In SR states, the activity is oscillatory and 
synchronized between neurons, while in Al states, neurons 
are desynchronized and fire irregularly, similar to recordings 
in awake cats (compare with cells in Fig. |5]l. The averaged 
activity of the network is coherent and of high amplitude 
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in SR states, but is very noisy and of low amplitude in AI 
states, similar to the EEG or LFP activity seen in wakeful- 
ness (compare with EEGs in Fig.[T]and LFPs in Fig.|5]l. 
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Fig. 7 Different network states in randomly-connected networks of 
spiking neurons. 

Top: state diagrams representing the average firing rate (left) and the 
firing irregularity (ISI CV, right) of a randomly-connected network 
of 5,000 integrate-and-fire neurons with a sparse connectivity of 2%. 
The phase diagram is drawn according to the excitatory and inhibitory 
quantal conductance. For increasing inhibition the dynamics undergo a 
transition from synchronous firing among the neuron and regular firing 
to a state where the synchrony has substantially decreased and neurons 
fire irregularly. The black rectangle indicates a transition from the SR 
to the AI regime. We selected this region for the rest of the study (see 
next figures). Bottom: the two different states, "Synchronous Regular" 
(SR, left) and "Asynchronous Irregular" (AI, right). The corresponding 
regions in the state diagram are indicated on top. For both panels, the 
upper part show a raster plot of a 500 neurons taken randomly from 
the network. Each dot is a spike emitted by the corresponding neuron 
across time. In the lower part, the mean firing rate computed among the 
whole network with a time bin of 0.1 ms. The asynchronous activity is 
reflected through the less fluctuating mean activity. 



The time series of these averaged network activities (bot- 
tom graphs in Fig.|7]l were analyzed similarly to the EEG in 
Section [3] We were particularly interested in the transition 
region between AI and SR states where the firing looses its 
coherence. This trajectory in the phase diagram is shown as 
a black rectangle in the upper panels of Fig. |7] and is charac- 
terized by a abrupt drop of activity concomitant with an in- 
creasing irregular firing. Similar results can be obtained by 
reducing the excitatory synaptic strength instead. However, 
to avoid a loss of stability, we preferred to study the tran- 
sition by increasing the inhibitory synaptic strength. Phase 
portraits of SR and AI states, as well as the corresponding 
recurrence plots, are illustrated in Fig. |8] As expected, SR 
states (leftmost panel in Fig. |8]l display a limit cycle phase 
portrait, while AI states (rightmost panel) appear as a dense 



unstructured attractor. When the dynamics is dominated by 
inhibition the limit cycle is rapidly blurred by small-scale 
fluctuations which become ubiquitous for AI states. How- 
ever, even though the phase portrait does not display any 
structure, the recurrence plot still exhibit a strong determin- 
istic component (diagonal line) which is completely lost for 
a state well beyond the boundary region (noisy recurrence 
plot). 
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Fig. 8 Recurrence plot and phase portraits of different network states. 
From left to right, different step of the transition from the SR state 
(leftmost) to AI state (rightmost). All states differed by the value of 
the inhibitory conductance 4g,„;,, as indicated. The top graphs indicate 
the recurrence plot. The diagonals indicate the existence of a domi- 
nant periodic component. As the slaved degrees of freedom are un- 
leashed with increasing inhibition, the recurrence plot is blurred by the 
stochastic-like component emerging at larger scales. This is the mani- 
festation of the transition to a high-dimensional dynamics. For network 
states in the middle of the AI region, there is almost no visible recur- 
rency and the recurrence plot looks like that of a stochastic process. 
The bottom graphs show bi-dimensional phase space reconstruction 
of the corresponding state. We can clearly see the "noisy" limit cycle 
which progressively degenerates into a dense high-dimensional attrac- 
tor confirming what is shown by the recurrence plot. 



To quantify this progressive release of degree of free- 
dom, we estimated the correlation dimension on the over- 
all activity for those different states. Fig. |9] shows the com- 
puted dimension for three different embedding dimensions. 
The network activity displays a low-dimension dynamics as 
expected for SR state whereas the dimension suddenly in- 
creases with increasing inhibition conductance. Moreover, 
the corresponding values don't saturate with increasing em- 
bedding dimension suggesting a high-dimensional attractor. 
Therefore, beyond the dotted black line, the correlation di- 
mension is not a relevant measure anymore. 

We also analyzed the spiking activity of the model us- 
ing the same statistical tools as for experimental data. The 
distribution of ISIs during AI states was largely dominated 
by an exponential component (Fig. [TOK. very similar to ex- 
perimental data (compare with Fig.|6K)- Analyzing popula- 
tion activity, through "avalanche analysis", displayed expo- 
nential distributions (Fig. HOB), also similar to experimental 
data (compare with Fig. |6^). Power-law scaling was also 
present for a limited range (see Fig. HOB, inset). Similar re- 
sults were obtained for different network states (not shown). 

One can ask what would be the effect of a more spe- 
cific connectivity architecture on these results. In previous 
work, we have shown that macroscopic properties in these 
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Fig. 9 Transition to a high-dimensional attractor in the AI regime. 
The correlation dimension is plotted according to the network state 
from the SR to the AI regime. Saturation of the scaling region in the 
correlation integral is shown by illustrating the estimated correlation 
dimension for three embedding dimensions. Below the dotted line, the 
measure is considered to saturate correctly whereas above this line, 
the measure can not be trusted anymore. In particular for low inhibi- 
tion conductances, there are severe shifts with increasing embedding 
dimension. The dotted line is given by the disappearance of the plateau 
in the e-entropy of Fig. [12] 



networks are conserved for more local connectivity, as long 
as the the connexions remain sparse [El Boustani & Des- 
texhe, 2009]. Therefore, the phase diagram for topological 
networks owns similar structures as those displayed in Fig.|2l 
However, in the limit of "first-neighbor" connectivity, corre- 
lations between neurons become significantly stronger and 
the resulting neuronal dynamics are more regular and far 
from biological observations. Thus, even though more lo- 
cal architectures can result in more correlated activity, these 
correlations have to remain small in order to preserve the 
network stability and the rich repertoire of regimes. Our re- 
sults are thus general for locally-connected networks as long 
as the sparseness is respected. 



A ISI distributions B Avalanche analysis 




200 400 600 800 10 20 30 40 



ISI (ms) Size 

Fig. 10 Analysis of the network dynamics in a model of asynchronous 
irregular states. 

A. ISI distributions during the AI state in a randomly-connected net- 
work of 16,000 integrate-and-fire neurons. ISI distributions are expo- 
nential (noisy trace), as predicted by a Poisson process (red line; in- 
set: log-log representation using natural logarithms). B. Absence of 
avalanche dynamics in this model (same description as Fig.[6}3). The 
red lines indicates regions of exponential scaling; the red line in inset 
indicates a region with power-law scaling. Modified from El Boustani 
et al., 2007. 



6 How to reconcile these data ? 

The above data show that in both human, cat and models, the 
dynamics can show clear signs of coherence and low dimen- 
sionality at the level of macroscopic measurements (EEG, 
LFPs, averages), while microscopically, neuronal dynamics 
are highly irregular and resemble stochastic processes. In an 
attempt to reconcile these observations, we rely on recently 
introduced generalization of classical nonlinear tools. In par- 
ticular, Finite-Size Lyapunov Exponent [Aurell et al., 1997; 
Shibata & Kaneko, 1998; Cencini et al., 1999; Gao et al., 
2006] and the e-entropy [Cencini et al., 2000] have proven 
to be valuable measures to probe system which display dif- 
ferent behaviors at different scales. In the present context, 
where low-dimensional dynamics can take place in top of a 
highly irregular neuronal behavior, those measures appear as 
the most natural. 

They were applied to the human EEG, as shown in Fig. II II 
The FSLE in the upper panel neither possess a plateau nor 
behave according to a power-law except in the small-scale 
limit where the stochastic-like component is dominant. For 
Creutzfeldt-Jacob disease as well as for epileptic seizure, 
however, it seems that a small region displays a almost scale- 
free behavior which would indicate a low-dimensional chaotic 
dynamics. Following [Shibata & Kaneko, 1998], it seems 
that the cortical activity lives in a high-dimensional attrac- 
tor which could be chaotic. Therefore, the FSLE does not 
really help to untangle the different scales dynamics here. 
However, when resorting to the e-entropy, we get a differ- 
ent picture. Fig. [TTB clearly shows that most of these cor- 
tical states manifest a large plateau on large-scale. These 
plateau is a signature of low-dimensional dynamics [Cencini 
et al., 2000] whereas the small-scale power-law behavior is 
the signature of stochastic-like dynamics produced by high- 
dimensional attractor. In accordance with Fig. [51 the dynam- 
ics during awake eyes open and REM sleep do not own a 
plateau, and their attractor dimension is too high to be distin- 
guished from noise. However, it should be noted that those 
different dynamics are produced by the same system hence 
being mainly modulated by endogenic factors. In light of 
this result, we can conclude that there is no contradiction 
between the experimental data acquired at the macroscopic 
level (EEG) and the at the microscopic level (Spiking Activ- 
ity). For large network of coupled units, averaged quantities 
can display low-dimensional structured dynamics while be- 
ing seemingly stochastic at a smaller scale. 

We also evaluated the same quantities from the aver- 
aged activities of the numerical model. In Fig. [T2K. we see 
as before that the FSLE does not exhibit any scale-free re- 
gion except for the small-scale limit. Thus we can not rely 
on this measure to distinguish small- and large- scale be- 
havior. In contrast, the e-entropy in Fig. [T2B yields a large 
and distinct plateau in the SR regime. The disappearance of 
this plateau have been used as a criteria to draw the dot- 
ted black line in Fig. [9) For inhibitory conductances larger 
than Agi„h ~ 23.5 (nS), the e-entropy slowly converges to its 
small-scale stochastic-like behavior. We thus recover a very 
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FSLE for different catical states 




A 



FSLE for different network regimes 



B 



e-entropv for different cortical states 




Fig. 11 Scale-dependent Lyapunov exponent and Epsilon-entropy for 
different brain states. 

Tiie scale-dependent Lyapunov exponent (A) and e-entropy (B) were 
calculated from the same EEG states as shown in Fig. [T] The FSLE 
(A) does not show any plateau and if the inverse FSLE is plotted 
in a semilog scale on the x-axis, no low-dimensional chaotic behav- 
ior can be detected for most states (data not shown). Following [Shi- 
bata & Kaneko,1998] example for general coupled maps, the macro- 
scopic activity seems to exhibit high-dimensional chaotic dynamics. 
For small scales e ^ 0, a scall-free region is found with a power- 
law exponent around 0.791 (black dotted line) as expected from the 
microscopic stochastic-like dynamics [Cencini et al., 2000; Gao et 
al., 2006]. Because of the absence of a large scale-free region in the 
semilog region, we can not define a macroscopic Lyapunov exponent 
from this measure. However, for the Creutzfeldt- Jacob disease and the 
epileptic seizure, the FSLE have a free-scale region on a broad range 
which is different from the other cortical states. This could indicate 
a low-dimensional chaotic dynamic even though it is not reflected in 
the semilog scale. Indeed, the e-entropy (B) manifests a clear plateau 
(red dotted line) for the epileptic seizure, the Creutzfeldt-Jakob dis- 
ease, sleep stage 2 and 4 and the alpha waves. These plateau indi- 
cates the existence of a low-dimensional attractor on the corresponding 
scales [Cencini et al., 2000] which can sometimes be easily visualized 
with an embedding procedure (see Fig.[T). For REM and awake states, 
this plateau disappears leaving the dynamics in a stochastic-like (high- 
dimension) state at all scales. The small-scale behavior is identical to 
the FSLE (green dotted line). 



comparable behaviour to the EEG data where pathological 
states or deep sleep produce structured activity at the EEG 
level and awake state or REM are comparable to the dynam- 
ics of Al regime, as suggested previously [van Vreeswijk & 
Sompolinsky, 2006; van Vreeswijk & Sompolinsky, 2008; 
Vogels & Abbott, 2005; El Boustani et al., 2007; Kumar et 
al., 2008]. 




B 



e-entrop/ fa dfferent network regimes 




Fig. 12 Scale-dependent Lyapunov exponent and Epsilon-entropy for 
different network states. 

The Finite-Size Lyapunov Exponent (A) and e-entropy (B) were cal- 
culated from the same network states as shown in Fig. |7] The FSLE 
behaves almost identically for every network state. There is no evi- 
dence for a low-dimensional chaotic dynamics which would be indi- 
cated by a scale-free region in intermediate scales. The power-law at 
small-scale owns a coefficient around 0.418 (black dotted line) charac- 
terizing the stochastic-like dynamic (high-dimensional deterministic) 
at those scales. Even though no evidence for low-dimension chaos can 
be found from the FSLE, the e-entropy (B) has a large plateau (red dot- 
ted line) for state lying in the SR region (low inhibitory conductance). 
This plateau is shortened when the network dynamics is driven toward 
the Al regime where eventually the dynamics is indistinguishable from 
stochastic process. The small-scale behavior is identical to the FSLE 
(green dotted fine). 



7 Discussion 

In this paper, we have briefly reviewed correlation dimen- 
sion analyses of human EEG, which revealed a hierarchy of 
brain states, where the dimensionality varies approximately 
inversely to the level of arousal (Fig-IHl. In particular, awake 
and attentive subjects display high dimensionalities, while 
deep sleep of pathological states show evidence for low di- 
mensionalities. These low dimensions are difficult to recon- 
cile with the fact that these signals emanate from the activity 
of millions (if not billions) of neurons. In cat cerebral cor- 
tex, the cellular activity during wake and sleep are highly 
irregular, and exponentially distributed like stochastic (Pois- 
son) processes, a feature which is also difficult to reconcile 
with low dimensionalities at the EEG level, even though LFP 
data do not manifest low-dimensional dynamics (data not 
shown). We performed similar analyses on computational 
models, which also display these apparently coherent activ- 
ities at the level of large-scale averages, while the micro- 
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scopic activity is highly irregular. In particular SR states can 
display coherent behavior at large scales, while AI states do 
not show evidence for coherence, similar to recordings in 
awake cats and humans. 

The nature of the dynamics exhibited by models is as- 
similable to high-dimensional chaos. It has been shown that 
AI states in such models shut down after some time, and are 
thus transient in nature [Vogels & Abbott, 2005; El Bous- 
tani et al., 2007; Kumar et al., 2008; El Boustani & Des- 
texhe, 2009]. This lifetime has been estimated to increase 
exponentially with the network size [Kumar et al., 2008; 
El Boustani & Destexhe, 2009], and can reach considerable 
times (beyond any reasonable simulation time; [Kumar et 
al., 2008]). Moreover, other recent studies [Cessac, 2008; 
Cessac & Vieville, 2008] have obtained analytical results on 
similar models where "transient chaotic-like regimes" were 
found. More precisely, these regimes are periodic, but with 
a period which also grows exponentially with network size. 
These results are reminiscent of the non-attractive chaotic 
manifolds extensively discussed in the literature [Crutch- 
field & Kaneko, 1988; Dhamala et al., 2001; Dhamala & 
Lai, 2002; Tel & Lai, 2008]. Hence, even though the chaotic 
nature of the dynamics is not inherent of the underlying sys- 
tem, the network spends a long enough period trapped in 
this transient dynamics indistinguishable from chaos from a 
numerical point of view. 

To characterize the dynamics at different scales, we es- 
timated quantities such as FSLE or e-entropy, which clearly 
show that microscopic scales (neurons) tend to be very high- 
dimensional and complex, in many ways similar to "noise", 
while more coherent behavior can be present at large scales. 
This analysis is consistent with the recently proposed con- 
cept of "macroscopic chaos", where a very high-dimensional 
microscopic dynamics coexists with low dimensionality at 
the macroscopic level. In this paper, the chosen numerical 
model is known to be purely deterministic and can display 
highly irregular spiking patterns close to stochastic processes 
or noise. From a nonlinear analysis point of view, most of 
this dynamics is indistinguishable from a random process. 
However, as soon as a large scale behaviour emerges, the 
e-entropy can keep track of it and still manifests the small- 
scale irregular fluctuations. 

We conclude that numerical models of recurrent neu- 
ronal networks, with conductance-based integrate-and-fire 
neurons, can be assimilated to high-dimensional chaotic sys- 
tems, and are in many ways similar to the EEC Moreover, 
even though they exhibit limit-cycle regimes for several pa- 
rameter sets, this collective dynamics is built on top of irreg- 
ular and high-dimensional neuronal activity which is only 
apparent at small-scales. Interestingly, this scheme reminds 
fluid dynamics, where a seemingly random microscopic dy- 
namics may also coexist with more coherent behavior at 
large scales. This is the case for example close to the transi- 
tion to turbulence, where fluids can show evidence for low- 
dimensional chaos [Brandstater et al., 1983]. More devel- 
oped turbulence, however, does not show such evidence, pre- 
sumably because a large number of degrees of freedom have 



been excited and the high-dimensional dynamics is present 
at all scales. It is possible that similar considerations apply 
to brain dynamics, especially when considering the recent 
debate about the nature of the ongoing activity of visual pri- 
mary cortex (VI). Recordings made using voltage-sensitive 
dyes imaging (VSDI) in this cortical area have suggested 
that spontaneous activity consists of a seemingly-random re- 
play of sensory-evoked orientation maps of activity in anes- 
thetized [Kenet et al., 2003], but not in awake animals [Omer 
et al., 2008]. These observations have raised the question of 
whether the cortical activity of VI could be described by a 
single-state high-dimensional attractor or a low-dimensional 
multistable attractor [Goldberg et al., 2004]. It is likely that 
at the VSDI scale, both scenarios are possible at the same 
time but at different scales, which would be consistent with 
the present results. 
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